Black Hole Entropy: From Shannon to Bekenstein 
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Abstract 



^ ! In this note we have applied directly the Shannon formula for information theory entropy to 
derive the Black Hole (Bekenstein-Hawking) entropy. Our analysis is semi-classical in nature 
since we use the (recently proposed [8]) quantum mechanical near horizon mode functions 
to compute the tunneling probability that goes in to the Shannon formula, following the 
general idea of [5]. Our framework conforms to the information theoretic origin of Black 

m 

Hole entropy, as originally proposed by Bekenstein. 

q 

Black Holes (BH) are, quite paradoxically, the simplest objects to describe (thermody- 

O ' 

namically) in terms of Bekenstein-Hawking entropy, Hawking temperature etc. [TJ [2] due 
to the "no hair" theorems leading to their universal characters, but at the same time, they 

>< ' 

are probably one the most complex systems if one tries to understand (in a statistical me- 
ed \ 

chanical way) the microscopic degrees of freedom (or equivalently quantum states) that are 
responsible for the huge BH entropy. In fact, the information theoretic origin of BH entropy 
was strongly emphasized by Bekenstein in the seminal work [2]. Quantitative estimation 
of information, or its loss in terms of information theoretic "entropy", was first defined in 
the pioneering work of Shannon [3]. Bekenstein, in [2] refers to Shannon's expression for 
entropy in his heuristic derivation of the BH entropy, but explicitly uses it only to fix the 
normalization of the BH entropy unit, a bit. One bit of information is associated with the 
knowledge of existence of just one particle and 1 bit corresponds to In 2 of entropy. This 
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easily follows from the Shannon formula [3] for entropy H, 

H = -^2p k lnp k , (1) 

k 

where in a very general context, p k denotes the probability of the system being in k-th state. 
For the particle entropy, it is numerically equal to maximum entropy In 2 if the chances of 
the particle existing or not are both equal to 1/2. Hence it was not clear if the Shannon 
formula was capable of giving the BH entropy. Also it is important to note, (as was stressed 
by Bekenstein j2]), a quantum treatment in evaluating the BH entropy seemed inevitable 
but unfortunately the requisite results were not available at that time. 

The connection between Shannon entropy and thermodynamic or statistical mechan- 
ics entropy was established by the works of Jaynes pi] and Brillouin [5]. More recently, 
Bialynicki-Birula and Mycielski [6] have exploited these ideas to introduce new forms of 
"entropic uncertainty relations" applicable to physics problems, that use Shannon entropy 
forms. In the present brief note we will follow j7] where the authors advocate the use of 
conventional quantum mechanical probability expressions to compute the Shannon entropy. 
Our aim is to compute the BH entropy using Shannon formula in a semi-classical frame- 
work. This will vindicate the early usage of information theory ideas in deriving BH entropy 
by Bekenstein and equally important, we will give a quantum mechanical, (at least semi- 
classical), treatment which although mentioned, was absent in |2j. This missing link has 
been given, very recently, by Banerjee and Majhi in [8] where they re-discover the explicit 
forms of quantum mechanical modes of the states inside and outside the BH horizon (see also 
This directly yields the probabilities of individual ingoing modes being trapped inside 
the BH horizon, (which is indeed unity), or tunneling out of the BH horizon and escaping to 
infinity to be perceived as Hawking radiation. The algebraic structure of these probability 
expressions are tailor-made for our purpose as they provide a back of the envelope derivation 
of BH entropy via Shannon formula. These quantum modes have been used recently [12] to 
show the possibility of non-divergent behavior for BH (Hawking) temperature as BH mass 
goes to zero and to indicate a possible solution to the information puzzle. 
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We follow the notations and conventions of [8]. In a very important paper by Robinson 
and Wilczek [10] it was observed that effective field theories become two dimensional and 
chiral near the event horizon of a black hole. Explicitly, upon transforming to the "tortoise" 
coordinate and performing the partial wave decomposition, it can be shown that the effective 
radial potentials for partial wave modes of the scalar field vanish expo- nentially fast near the 
horizon. Thus physics near the horizon can be described using an infinite collection of (1 + 
l)-dimensional fields. This approach has been used in various works This simplification 
allows us consider, in a BH background, the near horizon quantum dynamics of the degrees 
of freedom to be essentially two dimensional and the reduced metric in r — t sector, for a 
spherically symmetric and static spactime metric is, 

ds 2 = F(r)dt 2 - - r 2 dn 2 . (2) 

For Hawking radiation the radial motion is relevant. The massless Klein- Gordon equation 
in the above reduced metric is, 

<T v„v„0 = o. (3) 

One uses the WKB ansatz to solve the equation in a semi-classical Hamilton- Jacobi scheme. 
It is convenient to use tortoise coordinates and one has to keep in mind the change in 
the coordinates as the outgoing particle crosses the horizon (for details see [8]). Explicit 
expressions of the modes are 

^ (R) = 1 = 1 e -m e -|"«out H£ 6^} 
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In the above u is the energy of the particle as measured by an asymptotic observer and k 
is the surface gravity. The null tortoise coordinates are defined as u = t — r*, v = t + 
(r* = f corresponding to the 2 — d metric ds 2 = —F(r)dt 2 + J^y. Left (L) moving 

modes are ingoing and Right (R) moving modes are outgoing, with respect to the horizon. 
Notice that the modes are expressed in terms of an outside observer. The two-dimensional 



coordinate system in the null tortoise coordinates is locally conformally flat and hence the 
modes are normalized in the conventional flat spacetime way with an integral over a constant- 
time hyper surf ace £f 



-i I (<t>d t (/>* - (j)*d t <j))dx ; I e lk - x dx = 2ir5(k). 



(5) 



Now, with the probabilities normalized as above, probability of the left moving L modes 
to travel towards the centre of the black hole should be unity. Clearly this is the case since 
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On the other hand, probability for the right moving R modes to tunnel out through the 
horizon is, 



p(R) 



iu 
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as measured by an external observer. Utilizing the principle of detailed balance = 
e ~T p( L ) one recovers the Hawking temperature T = |^ [S] (see also discussions in [T5]). 

Armed with these inputs we are now ready to exploit the idea of Bialynicki-Birula and 
Rudnicki [7] to recover the BH entropy from Shannon formula . For the present case ([ID 
reduces to, 



H 



duj 



P{u) lnP{uj) 



duo 



exp(—au)(—aco), 



where we have scaled the energy-like variable u by cE P = c^J (hc?)/G, with Ep being 
the Planck energy, to make the Shannon entropy dimensionless and a = (2ir) / (Hk) = 
(8nGM)/(hc 4 ) from (CD [8J. Here k = (c 4 )/(4GM) is the surface gravity with M being 
the Black Hole mass. We have also reverted back to conventional c.g.s. system of units. A 
simple integration yields the result, 
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cE P a 8it(M/M p ) 
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(9) 



with Mp = (He) I G denoting the Planck mass. Note that only the probability for outgoing 
modes contribute since P( L \cu) = 1 for ingoing modes which when substituted in Shanon 
formula yields zero. 

Let us interpret this result in its proper perspective. We will attempt to relate this result 
to the entropy problem as perceived by an observer outside the BH horizon. Consider that 
a pair of left moving and right moving modes is created just outside the BH horizon. We 
would like to reduce the problem to that of a yes-no type of two state problem, that is 
simply whether a particle exists or not. According to the observer the right moving mode 
(that tunnels out) exists and hence contributes zero entropy. For the left moving mode that 
goes inside the horizon, we fall back on Bekenstein argument [2] and claim that we do not 
really know anything about the particle's existence or equivalently that it has equal (|) 
probability of existing or not existing. This means it is in a random state and can contribute 
the maximum entropy 1 bit. This is also justified since it is a well known result that the 
mean entropy carried away by a mode having thermal distribution is of the order of one 
bit. We put this as the upper bound of the amount of information that is lost by the BH 
( ^(m/Mf) ) fr° m within the horizon as a particle tunnels out. 

As we have mentioned, our aim is to relate the two expressions of entropy, ([9]) obtained 
from the black hole point of view and depending on black hole parameter M to the entropy 
considered just above, from a very general degree of freedom perspective. This in turn 
means that ^ M j Mp ^ amount of BH mass (in Planck units) corresponds to (87r)/n2 amount of 
(Shanon) entropy. Then an M/Mp-mass BH will correspond to (8n)ln2(M / Mp) 2 amount of 
(Shannon) entropy or more precisely 

Sbh < (ln2)8ir(M/M P ) 2 k B . (10) 

In the above, we have denoted Sbh to be the thermodynamic entropy which is obtained by 
multiplying the Shannon enropy by kp, the Boltzmann's constant. The above saturation 
result, 

S BH = (ln2)87T(M/M P ) 2 kp, (11) 
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in terms of the BH area A = 47ri?| = 47r(^^) 2 (for a Schwarzschild BH), reads 

Notice that after resurrecting the parameters in terms of fundamental constants our result 
looks tantalizingly close to the famous BH entropy expression of Bekenstein [2] 

S BH = (ln2/An)k B c z tr l G- l A, 

both expressionwise as well as numerically. Indeed it will be worthwhile to see whether our 
argument and the final result ( fl2l) can refined further. 

To conclude, we have attempted to apply directly the Shannon information theoretic 
formula to derive the Black Hole entropy. This is along the idea of Bekenstein and we quote 
from |2j: "At the outset it should be clear that the black hole entropy we are speaking of 
is not the thermal entropy inside the black hole." We have shown that it can be directly 
obtained from the Shannon formula of information entropy. Furthermore Bekenstein also 
emphasizes that a quantum analysis is necessary to account for the appearance of h in the 
entropy expression. In the present work we have used probability expressions obtained from 
wave functions derived very recently [8] in a semiclassical framework. The application of 
quantum results in Shannon's formula was outlined in j7]. We have taken Schwarzschild BH 
solution as an example but our analysis can be easily extended to generic forms of Black 
Holes. One only needs to substitute the appropriate expression for the surface gravity in the 
mode functions 0^ and 4^ ■ 

There are three interesting directions along which the present analysis can be extended. 
One is the application of "Entropic" Uncertainty Relations, developed by Bialynicki-Birula 
and co-workers, [EJE], m ^ ne present context. In a similar vein, extensions of laws to include 
quantum corrections due to conventional Heisenberg Uncertainty Relation and Generalized 
Uncertainty Relation have appeared in [15] in the context of "entropic" origin of gravity, 
recently proposed by Verlinde [16J. This actually brings us to the second direction of future 
work where it would be very interesting to derive rigorously Verlinde's conjecture [16] that 
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relates the entropy change in a holographic screen due to a particle's motion to its distance 
from the screen. Indeed it seems natural that Shannon's entropy formula should come in to 
play since it was stressed by Verlinde [E] that the origin of gravity is entirely information 
theoretic. Since Verlinde's entropic analysis of Newton's law of gravitation resides in flat 
spacetime, the global embedding procedure, recently developed in [T7], that studies the 
Hawking effect (curved spacetime) and Unruh effect [18] (Minkowski spacetime), can play 
an important role. The third is to apply the line of argument presented here in obtaining 
entropies for more general type of black holes, such as Kerr black hole in particular. 
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